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Device to generate a three-dimensional image of a moved object 
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The invention relates to a method and a device for generating a three- 
dimensional image of an object e.g. the heart, which is subject to cyclic movement. 

5 US 2002/0126794 Al discloses a rotation X-ray device with which three- 

dimensional images of a patient's heart can be reconstructed. One problem with such 
reconstructions is that the object to be shown is not static but because of the heart beat is 
subject to a cyclic movement. Another important source for the movement of organs in 
medical examinations is the respiration of a patient. The 2D projections of the heart taken 

10 with a rotation X-ray device from various directions show the heart in different movement 
states. If these projection images are used to reconstruct a 3D image of the heart on the 
assumption that they reflect a static object, reconstruction errors necessarily occur. To 
minimize such errors US 2002/0126794 Al proposes recordmg the electrocardiogram (ECG) 
in parallel to the X-rays and then using for reconstruction of the three-dimensional image 

15 only those X-ray pictures which correspond to approximately the same ECG phase. With 
such a method oriented to the ECG phase a substantial improvement in the 3D reconstruction 
can be achieved. Nonetheless it appears that furthermore certain inaccuracies and artifacts 
can occur in the reconstructed image. 

In this context one object of the invention is to provide means for generating 

20 three-dimensional images of a cyclically moved object such as in particular the heart, which 
give improved image quality. 

This object is achieved by a device with the features of claim 1 and by a 
method with the features of claim 8. Advantageous embodiments are contamed in the sub- 
claims. 

25 The device according to the invention serves to generate a three-dimensional 

image of an object which is subject to a cyclic movement. The object can in particular be a 
patient's heart, where the invention is not however restricted to medical applications. The * 
device contains an imaging device with which two-dimensional projection images of said 
object can be generated from different projection directions. The device furthermore contains 
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a data processing device coupled with said imaging device which is designed, for example by 
fitting with corresponding software, to reconstruct from the projection images a three- 
dimensional image of the object. Processes and algorithms suitable for this task are for 
example known from the field of computer tomography. The data processing device is 

5 furthermore designed to select and use for said reconstruction of the three-dimensional image 
only those projection pictures for which the projection lines of a characteristic object feature 
intersect approximately at the same spatial point A "characteristic object feature" is a feature 
which is attached to the object and follows its movements, identifies a body point and which 
can be shown as well as possible on the projection pictures. The object feature can for 

10 example be a marker on the object which stands out weU on the projection pictures. 

"Markers" in this respect can e.g. also be a catheter or a stent (vessel connector). Similarly 
the object feature can be part of the object, for example a branch point of an object structure. 
In the context of medical applications in particular the branch point of a vessel can serve as 
an object feature. Furthermore the "projection hne" of an object feature is the (imaginary) 

15 spatial line which for a given projection picture leads jfrom the projection center through the 
object feature to the image point of the object feature on the projection plane or projection 
picture. In an X-ray hnage the projection line e.g. corresponds to the path of the X-ray beam 
from the beam source through the object feature to the associated pixel on the detector. 
Furthermore for the "approximate intersection" of projection lines (which evidentiy must 

20 include a precise intersection), depending on the peripheral conditions concerned, a suitable 
decision limit must be established in individual cases. For example all such projection lines 
can be regarded as intersecting approximately at the same spatial point if they draw closer 
togetiier than 1% to 5% of the maximum width of the projection picture. Similar standards 
can evidently also be defined using other reference values such as for example the object 

25 size. 

Using the device described it is possible to create three-dimensional images of 
a moved object in high quality, as for reconstruction of the 3D image only those two- 
dimensional projection pictures are used which already match well at the point of (at least) 
one characteristic object feature. It is therefore to be assumed that these projection pictures 
30 also correspond in the other object points or that for the selected projection pictures the 

object was in the same phase of cyclic movement and therefore had assumed approximately 
the same spatial position. When the device is used to show the heart, in contrast to the known 
processes based on the electrocardiogram, the advantage appears that the movement state of 
the heart is used directly as a selection criterion. The selection of projection pictures from the 
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same ECG phase however is based implicitly on the assumption that the movement phase of 
the heart cycle is also clearly linked to the electrical phase. This assumption is however not 
always fulfilled precisely so that with the known ECG-based processes, reconstruction errors 
can occur. These errors are in principle excluded with the device proposed here. 
5 Said condition for the selection of projection pictures for reconstruction of a 

three-dimensional image can evidently also be imposed similarly for more than one object 
feature. The selection method can thus e.g. be performed iteratively with one object feature 
after the other where the selection of projection pictures produced on each iteration is used as 
the basis for the next iteration, so the selection becomes ever narrower. In this case the 
10 precision increases as the position of the object in the selected projection pictures abready 
matches at a corresponding number of points. 

For the imaging part of the device in principle any device can be used with 
which projection pictures of an object can be generated from different directions, from which 
pictures a three-dimensional image can be reconstructed. Examples of these are an ultrasound 
15 device or an NMR device. In particular the imaging device can also be an X-ray device with 
an X-ray source and an X-ray detector which are rotatably mounted about a common axis. 
X-ray machines of this type are known from 3D rotation angiography '(3D-RA) and the X-ray 
source and detector are typically attached to a C-aim. 

Furthermore the device preferably comprises a display device coupled with a 
20 data processing system such as for example a monitor on which the reconstructed three- 
dimensional image can be shown. Such a display device allows for example a doctor to 
display visually the results of the three-dimensional reconstruction and analyze this directly 
for his diagnostic or therapeutic activities. 

According to a preferred embodiment of the device the data processing 
25 machine is set up to perform the following steps: 

a) selection of a first projection picture from a number of several projection 

pictures from different projection directions. This selection of the first projection picture can 
be arbitrary (e.g. on a random principle), interactive by a user or from other application- 
specific criteria (e.g. the imaging quality or associated ECG phase). 
30 b) for the first said projection picture, a second projection picture taken from 

another projection direction is selected such that the projection lines of a characteristic object 
feature for the first and second projection picture intersect at least approximately at a spatial 
point. The characteristic object feature can ui particular be located by a method of automatic 
image processmg or interactively by a user and should be such that it can be detected in as 
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many projection pictures as possible. After locating the characteristic object feature on a 
particular projection picture, the spatial projection line is calculated from the projection 
center to the image point of the object feature so that it can be checked whether it intersects 
approximately the corresponding projection line of the furst projection picture. If this is the 
5 case the projection picture concerned is selected as the "second projection picture". The 
intersection point of the projection lines thus establish the spatial point which corresponds to 
the (presimied) actual position of the object feature and which is used for the subsequent 
selection of further projection pictures. 

c) further proj ection pictures for reconstruction of the three-dimensional image 

10 are selected such that the associated projection lines of the object feature used m step b) run 
approximately through the spatial point determined in step b). In total thus successively a 
sub-quantity of projection pictures is selected from the given number of projection pictures 
which match each other in relation to the spatial position of the characteristic object feature 
concerned. 

15 With the embodiment of the invention described above, the projection 

direction of the second projection picture preferably lies at an angle of around 90° to the 
projection direction of the first projection picture. In particular it can lie in an angular range 
between 70** and 1 10° to the first projection direction. In this way the spatial point which is 
later used for the selection of all projection pictures used for reconstruction can be 

20 established with maximum precision. Based on the first projection picture, of this spatial 

point namely only two of its three degrees of freedom are established as its position along the 
projection line of the first projection picture cannot be determined. The third degree of 
freedom is determined by the intersection of the projection lines of the second projection 
picture with the projection line of the first projection picture. In the case of a second 

25 projection picture essentially perpendicxilar to the first projection picture, any error in 
determining the position of the object feature m the projection is carried forward to a 
TninimTim in the determination of the spatial point. 

The invention further relates to a method for producing a three-dimensional 
image of an object which is subject to a cyclic movement, the method comprises the 

30 following steps: 

a) generation of a number of projection pictures of the object from various spatial 
directions; 

b) selection of projection pictures for which the projection lines of a 
characteristic object feature intersect approximately at the same spatial point; 
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c) reconstruction of the tbree-dimensional image from the projection pictures 

selected in step b). 

The method in general comprises the steps which can be executed with a 
device of the type defined above. For the further explanation of the method and its 
5 advantages therefore reference is made to the above description of the device. In particular 
die method can be refined according to the features of the variants of the device and for 
example comprise the steps which can be executed with the data processing device as 
claimed in claim 6. 

In an optional embodiment of the method the projection pictures are generated 
10 by X-ray projection of the object, where the respective projection centers firom which the 
X-ray beam is emitted are distributed approximately on a circle arc about the object. 
Typically the circle arc extends over a range of about 180^ in order to cover all independent 
projection directions. 

Furthermore the three-dimensional image reconstructed according to the 
15 method is preferably shown on a display device to be able to be analyzed visually by the user. 



The invention will be fiirther described with reference to examples of 
embodiments shown in the drawmgs to which however the invention is not restricted. These 
20 show: 

Fig, 1 diagrammatically the stmcture of a device according to the invention to 
genemte a three-dimensional image of the heart, 

Fig. 2 a principle view of the conditions in the selection according to the 
invention of two-dimensional projection pictures of the same movement state of the heart, 
25 Fig. 3 the size of the euclidean interval An between the projection of a spatial 

point Jo which corresponds to the spatial position of the object feature in a particular heart 
phase, and the position of the image point of this object feature on a viewed projection 
picture with index n. 



The mvention will be explained below without restriction of generality using 
the example of a medical application, namely the three-dimensional imaging of the heart or 
the coronary vessels of a patient. The device used for this according to Fig. 1 as an example 
device comprises a rotation X-ray apparatus 1 with an X-ray source 2 and an X-ray detector 
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5. The X-ray source 2 and the X-ray detector 5 are arranged opposite each other on a C-arm 6 
and can be swiveled about the patient 3 lying on a couch 4 (two swiveled positions as shown 
in dotted lines in the figure). The X-ray projection pictures Pm , Pi, Pi+i , .... of the heart 
generated from various projection directions are transmitted to a data processing device 7 
5 (e.g. a work station) used for control and image processing. The data processing device 7 
comprises in particular software with image processing algorithms with which from the two- 
dimensional projection pictures Pn , Pi, Pt+i, . , . ., the three-dimensional form of the object or 
its structures for example coronary vessels, can be reconstructed. The corresponding 
algorithms are known from computer tomography and therefore need not be explained in 
10 more detail here. The result of the three-dimensional reconstruction can be shown on a 
monitor 8 coupled to a data processing device 7 in order to give the treating doctor an 
overview image of the vascular tree. 

In said reconstruction for a three-dimensional image of the coronary vessels, it 
must be noted that because of the heart beat, the heart is subject to a cyclic movement. The 
15 projection pictures Pi.i , Pi, Pi+i,.... produced therefore stem from different phases Ti, T2, T3 
of the cardiac cycle during which the heart assumes different spatial positions. For the 
reconstruction only those two-dimensional projection pictures (e.g. Pj.i , Pi+i) should be used 
which correspond to the same cardiac movement phase (e.g. T2 which can be the end of a 
diastole). In known methods the corresponding selection of projection pictures takes place on 
20 the basis of a parallel recorded electrocardiogram. The ECG however primarily represents the 
electrical state of the cardiac cycle, which does not always correlate to the movement state. In 
known methods the reconstructed 3D image thus often has a residual inaccuracy. 

To avoid the outlined problems, primarily the method explained in more detail 
below with reference to Fig. 2 is proposed for the selection of projection pictures for the 
25 reconstruction of a 3D image. Fig. 2 shows in a perspective principle view the geometric 

conditions m the taking of projection pictures Pi, Pj, Pk, Pi Each of the projection pictures 

arises as a central projection of an object starting from a projection center Si, Sj, Sk, Si 

The project centers correspond to the position of the X-ray source 2 during the projection 
picture concerned and are distributed on a curve (e.g. circle arc) which in the optimum case 
30 covers an angle of more than 210°. The radiographed object 9 is shown in the center for the 
time of projection picture P| where it must be pointed out that during the other projection 
pictures it usually has a different form and position. The vascular branch contained in the 
object 9 constitutes a suitable object feature as it marks a point on the object 9 which in 
(almost) all projection pictures can be located relatively well. Instead of a vascular branch a 
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marker can be used as an object feature such as for example a position marker impervious to 
X-rays on a catheter. 

At production of the projection picture Pj the object feature which is the 
branch of object 9 lies at a spatial point ro which is initially unknown. This spatial point ro is 

5 shown starting from the projection center Si via the projection line li in the image point X] of 
the object feature on the projection picture Pi. The position of the image point Xj in the 
projection picture Pi can be located interactively or automatically using known methods of 
image processing. Similarly the position of the image point of the object feature on the other 
projection pictures can be determined (e.g. the image points Xj, Xk in projection pictures Pj or 

10 PiO which were taken from other projection directions and usually belong to other phases of 
the cardiac cycle. 

From the projection pictures a first projection picture Pj is now selected at 
random by interaction of a user or otherwise. Starting from this all further projection pictures 
are determined which were taken in a similar movement phase of the heart as the first 

15 projection picture Pi. To this end first a second projection picture is selected. According to a 
first criterion its projection direction should lie approximately at an angle a of 90** to the 
projection direction of the first projection picture Pj. In the view in Fig. 2 thus the projection 
pictures about Pk are prunarily concerned. For these projection pictures Pk,. . .. then according 
to a second criterion it is examined whether the associated projection lines Ik, ... . intersect the 

20 projection line li of the first projection picture Pi or come closer to this than the prespecified 
maximmn distance. In Fig. 2 this is the case for projection line Ik which comiects the 
projection center Sk with the hnage point Xk of the object feature on the projection picture Pk. 
The projection picture Pk thus determined is then established as the "second projection 
picture" and the (approximate) intersection of projection lines li and Ik defmes, for the further 

25 process, the spatial point ro at which the object feature (vessel branch) was presumably 
located during the basic cardiac movement phase. 

The selection explained above of the second projection picture Pk can be 
performed in an equivalent manner using epipolar lines. For the projection picture Pk the 
epipolar line Ek(i) is drawn in dotted lines. It corresponds to the theoretical projection of the 

30 projection line li taken from the projection center Sk and therefore describes all theoretically 
possible locations of the object feature from knowledge of only the first projection picture Pi. 
The latter mainly establishes the spatial position of the object feature only to one degree of 
freedom, as it cannot be decided from the projection picture Pj where on the projection line U 
the object feature lies. Using the epipolar lines now for every other projection picture the 
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euclidean interval can be calculated of the image point Xk,. . located on the respective 
projection picture Pk,. . of the object feature from the corresponding epipolar line Ek(i). The 
second projection picture Pk to be selected is distinguished in that its object feature image 
point Xk has the smallest distance from the associated epipolar line Ek(i). 

5 Using the first and the second projection pictures Pj and Pk as stated, the spatial 

point ro of the position of the object feature during the cardiac phase concerned can be 
determined. Thus this spatial point ro can be projected theoretically onto any other projection 
pictures. For example for projection picture Pj point X'j is calculated at which the spatial 
point ro is projected from projection center Sj. The euclidean distance Aj between this 

10 projection point X'j and the image point Xj of the object feature in the projection picture Pj 
constitutes a measure of how greatly the cardiac movement phase in which projection picture 
Pj is taken deviates from the cardiac movement phase during the first and second projection 
pictures Pi, Pk. For the desired reconstruction of a three-dimensional image thus in a targeted 
manner those projection pictures Pj can be selected for which said distance is nil or Ues below 

15 a prespecified threshold. 

With said method thus from the series of projection pictures Pi, Pj, Pk, Pi 

those can be selected which belong to the same cardiac movement phase, wherein 
advantageously true movement data and not derived electrical activities are used to determine 
the cardiac cycle. It is furthermore advantageous that the object feature used can be selected 

20 from a particularly interesting region of the object 9 and this region as priority is represented 
with high precision in the three-dimensional image. 

Fig. 3 shows, for the projection pictures arranged according to the projection 
direction and numbered vnth index n (horizontal axis), the respective size of the euclidean 
distance 4, defined above between the calculated projection of the spatial point ro and the 

25 respective image position of the object feature. The cyclic variation corresponding to the 
cardiac rhythm is clear. For reconstruction of the three-dimensional image according to the 
above method, only the projection pictures from the "valleys" of the curve are used. 



